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A microprocessor controlled toy building element with 
visual programming 

This invention relates to a microprocessor controlled toy 
5 building element comprising a microprocessor which can 
execute instructions in the form of a program stored in a 
memory; a display integrated in the toy; coupling means 
for coupling with building elements which can be moved by 
manoeuvring means, said manoeuvring means being control- 
lable in response to the instructions. 

In connection with the development of small, sophisti- 
cated and relatively inexpensive microprocessors it has 
become attractive to use these in many different consumer 

15 products - including toys. Generally, the development of 
toys has proceeded from simple functions such as playing 
of sounds in dolls, performance of simple patterns of 
movement in robots, etc., to the development of toys with 
sophisticated behaviour. The sophisticated behaviour can 

2 0 be recognized by a child playing with the toy and give 
the impression of a kind of personality. Particularly in 
connection with construction toys there are many possi- 
bilities of giving the toy a behaviour by combining pro- 
gram steps for a microprocessor controlled toy building 

25 element with a self -built mechanical structure. 

Such programmable construction toys are known from the 
product ROBOTICS INVENTION SYSTEM from LEGO MINDSTORMS, 
which is a toy which can be programmed by a computer to 
detect a plurality of physical signals and to respond to 
these signals by implementing physical actions. The toy 
may e.g. be incorporated as a component in a vehicle by 
combining the toy with other toy building elements, e.g. 
motors, wheels, collision detectors and light detectors. 
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WO 90/02983 relates to a robot toy element which is con- 
trolled by a microprocessor and which can be programmed 
via an incorporated keyboard. The robot toy element can 
5 move according to patterns of movement and respond to ex- 
ternal influences . 

US 5,724,074 is an example of a toy element which can be 
programmed. The toy element can be programmed from an ex- 
10 ternal computer by means of a graphic user interface. 

The above-mentioned principles of programming toy ele- 
ments, however, are inexpedient for use in microprocessor 
controlled toy building elements. Particularly when the 

15 microprocessor controlled toy building elements can be 
coupled with other building elements to form a structure 
which can perform a pattern of movement, which depends 
partly on the structure and partly on the program per- 
formed by the microprocessor controlled toy building ele- 

20 ment. In such a situation, a change in the structure af- 
ter it has been programmed may result in a structure 
which does not work. This is evident to adults, but to 
children who play in an intuitive - and partly unstruc- 
tured - way, this will none the less be a typical situa- 

25 tion. The known toy cannot handle such situations in a 
satisfactory manner. 

In view of the prior art in the field, it is a problem 
that the programming and control facilities for micro- 
3 0 processor controlled toy building elements are insuffi- 
cient . 
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Accordingly, an object of the invention is to provide im- 
proved programming and control facilities for such micro- 
processor controlled toy building elements. 

5 This is achieved when the microprocessor controlled toy 
building element mentioned initially is characterized in 
that the display comprises a plurality of icons which 
each represent instructions for the microprocessor, and 
which can be activated by a user for programming of the 
10 microprocessor, and by signalling with a first one of the 
plurality of icons, said first icon representing instruc- 
tions which the microprocessor is executing. 

This ensures that the user of the toy receives an indica- 
15 tion of which instructions, rules or program steps the 
microprocessor is programmed to execute - and executes 
while signalling with the icon. This makes it easy for 
the child to proceed by the method of trial and error and 
get assistance in finding errors, if any, in the program 
20 or in the structure. 

It is thus possible to program a toy element in a simple 
manner. It is moreover possible to make the toy element 
perform sophisticated functions based on a few and intui- 
25 tive activations from a user. 

A preferred embodiment of the invention will be described 
below with reference to the drawing, in which 

3 0 fig. 1 shows a block diagram of a programmable toy ele- 
ment ; 



fig. 2 shows a display on a toy element; 
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fig. 3a shows a first diagram of a state machine for vis- 
ual programming of a toy element; 

fig. 3b shows a second diagram of a state machine for 
5 visual programming of a toy element; 

fig. 3c shows a third diagram for interrupting a state 
machine ; 

10 fig. 3d shows a fourth diagram for starting a state ma- 
chine ; 

fig. 4 shows parallel and sequential execution of pro- 
grams ; 



fig. 5 shows first and second toy elements, where the 
first toy element can transfer data to the second toy 
element ; and 

2 0 fig. 6 shows a toy structure comprising a microprocessor 
controlled toy building element according to the inven- 
tion coupled with generally known toy building elements. 

Fig. 1 shows a block diagram of a programmable toy ele- 
25 ment. The toy element 101 comprises a plurality of elec- 
tronic means for programming the toy element so that it 
can affect electronic units (e.g. motors) in response to 
signals picked up from various electronic sensors (e.g. 
electrical switches) . 



The toy element may hereby be caused to perform sophisti- 
cated functions such as e.g. action controlled movement, 
provided that the toy element is combined with the elec- 
tronic units/sensors in a suitable manner. 
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The toy element 101 comprises a microprocessor 102 which 
is connected to a plurality of units via a communications 
bus 103. The microprocessor 102 can receive data via the 
5 communications bus 103 from two A/D converters "A/D input 
#1" 105 and "A/D input #2" 106. The A/D converters can 
pick up discrete multibit signals or simple binary sig- 
nals. Further, the A/D converters are adapted to detect 
passive values such as e.g. ohmic resistance. 

10 

The microprocessor 102 can control electronic units such 
as e.g. an electric motor (not shown) via a set of termi- 
nals "PWM output #1" 107 and "PWM output #2" 108. In a 
preferred embodiment of the invention the electronic 
15 units are controlled by a pulse width modulated signal. 

Moreover, the toy element can emit sound signals or sound 
sequences by controlling a sound generator 109, e.g. a 
loudspeaker or piezoelectric unit. 

20 

The toy element can emit light signals via the light 
source "VL output" 110. These light signals can be emit- 
ted by means of light emitting diodes. The light emitting 
diodes may e.g. be adapted to indicate various states of 
25 the toy element and the electronic units/sensors. The 
light signals may furthermore be used as communications 
signals for other toy elements of a corresponding type. 
The light signals may e.g. be used for transferring data 
to a second toy element via a light guide. 

30 

The toy element can receive light signals via the light 
detector "VL input" 111. These light signals may be used 
inter alia for detecting the intensity of the light in 
the room in which the toy element is present. The light 
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signals may alternatively be received via a light guide 
and represent data from a second toy element or a per- 
sonal computer. The same light detector may thus have the 
function of communicating via a light guide and of serv- 
5 ing as a light sensor for detecting the intensity of the 
light in the room in which the toy element is present. 

In a preferred embodiment, the 11 VL input" 111 is adapted 
to selectively either communicate via a light guide or 
10 alternatively to detect the intensity of the light in the 
room in which the toy element is present. 

Via the infrared light detector " IR input /output " 112 the 
toy element can transfer data to other toy elements or 
15 receive data from other toy elements or e.g. a personal 
computer . 

The microprocessor 102 uses a communications protocol for 
receiving or transmitting data. 



The display 104 and the keys "shift" 113, "run" 114, "se- 
lect" 115 and "start/interrupt" 116 constitute a user in- 
terface for operating/programming the toy element. In a 
preferred embodiment, the display is an LCD display that 
25 can show a plurality of specific icons or symbols. The 
appearance of the symbols on the display may be con- 
trolled individually, e.g. an icon may be visible, be in- 
visible and be caused to flash. 

3 0 By affecting the keys the toy element may be programmed 
at the same time as the display provides feedback to a 
user about the program which is being generated or exe- 
cuted. This will be described more fully below. As the 
user interface comprises a limited number of elements 



20 



WO 00/45924 



• 



PCT/DK00/00051 



7 



(that is a limited number of icons and keys) , it is en- 
sured that a child who wants to play with the toy will 
quickly learn how to operate it. 

5 The toy element also comprises a memory 117 in the form 
of RAM and ROM. The memory contains an operating system 
"OS" 118 for control of the basic functions of the micro- 
processor, a program control "PS" 119 capable of control- 
ling the execution of user- specified programs , a plural - 
10 ity of rules 12 0 , each rule consisting of a plurality of 
specific instructions for the microprocessor, and a pro- 
gram 121 in RAM which utilizes the specific rules. 

In a preferred embodiment, the toy element is based on a 
15 so-called single chip processor which comprises a plural- 
ity of inputs and outputs, a memory and a microprocessor 
in a single integrated circuit. 

In a preferred embodiment, the toy element comprises 
2 0 light emitting diodes which can indicate the direction of 
revolution of connected motors . 

In a further embodiment, the toy element comprises incor- 
porated manoeuvring means in the form of e.g. one or more 
25 motors with take-off in the form of shafts that are 
driven by the motors, or in the form of coupling holes 
with means for receiving part of a shaft and rotating 
this shaft. 

30 Fig. 2 shows a display on a toy element. The display 201 
is adapted to show a plurality of specific icons and is 
shown in a state in which all the icons have been made 
visible. The icons are divided by horizontal and vertical 
beams 202 and 203, respectively, into a plurality of 
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groups 204, 205, 206, 207 and 208 according to their 
function. 

The icons may e.g. be designed to illustrate possible 
5 patterns of movement for a vehicle. A vehicle may e.g. be 
constructed by combining the toy element with two motors 
which can drive a set of wheels at the right-hand side 
and the left-hand side, respectively, of a vehicle. The 
vehicle may hereby be controlled to drive forwards, back- 
10 wards, to the left and to the right. Further, the vehicle 
may comprise pressure- sensitive switches for detecting 
collision and light-sensitive sensors. 

The group 2 04 includes icons for a straight and forwardly 
15 directed pattern of movement, a forwardly directed zigzag 
pattern of movement , a circular movement and a movement 
which repeats a given pattern. These patterns of movement 
are not conditioned by the action of sensors and are 
therefore unconditioned. 

20 

The group 205 includes a first icon for a pattern of 
movement, which is reversed when an obstacle is detected. 
A second icon shows a straight and forwardly directed 
pattern of movement, where the forwardly directed move- 

25 ment is merely corrected by the detection of an obstacle. 
A third icon conditions initiation of a pattern of move- 
ment. A fourth icon stops an ongoing pattern of movement 
when a pressure sensor is activated. The icons in the 
group 205 thus represent patterns of movement which are 

30 conditioned by pressure-sensitive sensors. 

The group 206 includes icons for starting a pattern of 
movement which moves toward the strongest light intensity 
and a pattern of movement which moves toward the weakest 
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light intensity, respectively. The light intensity is de- 
tected by means of light-sensitive sensors. The icons in 
the group 205 thus represent patterns of movement which 
are conditioned by light-sensitive sensors. 

The group 2 07 includes three identical icons which can be 
displayed in combination to indicate the time constant at 
which the mentioned patterns of movement are to be per- 
formed. For example, the zigzag pattern may be modified 
by stepwise changing the period of time which has to 
elapse before the direction is changed. The time constant 
may e.g. be 2 seconds, 4 seconds and 7 seconds. 

The group 208 comprises icons which represent a plurality 
of special effects. These effects may e.g. comprise emis- 
sion of various sound and light signals optionally com- 
bined with an arbitrary activation of the mentioned pat- 
terns of movement . 



It should be noted that the display may be of LCD type, 
LED type or another type. The display may moreover be 
adapted to show various forms of text messages . Icons may 
also be text. 

Fig. 3a shows a first diagram of a state machine for vis- 
ual programming of a toy element . The state machine is 
implemented as a program which can be executed by the mi- 
croprocessor 102. When the state machine does not execute 
a user- specif ied program, and when the toy element has 
been turned on, activation of the key "select" will di- 
rect focus from one group of icons to another group of 
icons. That a group of icons is in focus may be shown by 
flashing an icon in a group or all the icons in a group. 
The state machine shown comprises three states 301, 302 
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and 3 03 corresponding to switching focus between three 
different groups of icons . 

The state machine changes states when the keys "select" 
5 or "shift" are activated. When the key "select" is acti- 
vated, switching takes place between the states 301, 302 
and 303. When the key "shift" is activated, the state ma- 
chine continues in another set of states shown in fig. 
3b. 

10 

It should be noted that just three states are indicated 
in this program, corresponding to three groups of icons 
on the display 201. This has been chosen in order to make 
the diagram readily understandable. In practice, there 
15 must be a number of states corresponding to the number of 
groups of icons on the display. 

Fig. 3b shows a second diagram of a state machine for 
visual programming of a toy element. The state machine is 

2 0 caused to assume these states when the key "shift" is ac- 

tivated. It is assumed that a group of icons has been fo- 
cused. When "shift" is activated, the state machine as- 
sumes the state 3 04 in which the first icon in the group 
which has been focused is activated - the other icons in 
25 the same group are not shown. 

If the key "select" is activated, the state machine as- 
sumes the state 3 05 where "rule #1" is selected. "Rule 
#1" corresponds to a set of instructions for the micro- 

3 0 processor 102 which can perform a pattern of movement as 

shown on the icon "icon #1". Then the state machine as- 
sumes the state 3 06 where focus is moved from the current 
group of icons to another group of icons for the selec- 
tion of an icon in this group. 
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Alternatively, if the key "shift 11 is selected in the 
state 3 04, the state machine assumes the state 307, where 
the "icon #2" is shown on the display - the other icons 
5 in the same group are not shown. Like in the state 3 04, 
it is possible in the state 307 to select a rule corre- 
sponding to the icon. This is done by activating the key 
"select", and then the state machine assumes the state 
308 for the selection of the rule "rule #2". Subse- 
10 quently, in state 3 09 focus is moved to the next group of 
icons . 

Correspondingly, "icon #3" may be displayed in state 310 
by activation of "shift". "Rule #3" may be selected by 
15 activation of "select", following which focus is moved to 
another group . 

A further activation of "shift" in the state 310 causes 
all the icons in the group to be shown, and then the 

2 0 icons in the group are shown individually as described 

above . 

In the states 306, 309 and 312, activation of the key 
"shift" will cause the state machine to assume one of the 
25 respective states 302 or 303 or 301. 

It should be noted that it is also possible not to select 
a rule in one or more groups. In alternative embodiments, 
it can moreover be made possible to select several rules 

3 0 in the same group. 

Additionally, it should be noted that this diagram corre- 
sponds to a display with just three icons in each group. 
This has been chosen to make the diagram readily under- 
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standable. In practice, there must be a number of states 
corresponding to the number of icons in a given group. 

Generally, activation of the key "run" 114 will cause the 
state machine to assume a state in which a program is 
executed - irrespective of the number of selected rules . 
Thus, it is not necessary to ask the user whether the 
program is ready or not . 

It is possible to jump to a desired group of icons in or- 
der just to change a rule in a user- specif ied program 
consisting of several rules. 



Fig. 3c shows a third diagram for the interruption of a 
state machine. This diagram shows how the state machine 
in state 314, upon activation of "interrupt", stores a 
representation of the state T in which the microproces- 
sor/state machine is present. It is hereby possible to 
resume a suddenly interrupted programming course without 
having to start from scratch. The toy element is turned 
off in state 315. 

Fig. 3d shows a fourth diagram for starting a state ma- 
chine. This diagram shows how the state machine, upon ac- 
tivation of "start", turns on the toy element in state 
316. Then, a previously stored state representation T is 
retrieved in state 317. In state 318, the icons repre- 
senting the state T are shown. In state 319, the icons in 
group 1 are focused, and then the state machine is ready 
for operation as described in connection with figs. 3a, 
3b and 3c. 



As will appear from the above description of figs. 3a, 
3b , 3c and 3d, the user can program the toy element in a 
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simple maimer to execute programs which comprise compli- 
cated functions. The programs are generated by combining 
a number of specific rules. 

The state machine described above may be implemented in a 
very compact manner. It is ensured hereby that sophisti- 
cated and user- specif ied functions can be performed in 
response to a simple dialogue with the user. 

In the states where a rule is selected, that is the 
states 3 05, 3 08 and 311, the program system 119 executes 
a number of operations, thereby generating a user-speci- 
fied program which can be executed by the microprocessor 
102 . 

The user- specif ied program can be generated by storing a 
reference (that is a pointer) in the memory 121 which re- 
fers to a rule stored in the memory 12 0. When several 
rules are selected to be included in the same user-speci- 
fied program, a list of references to rules in the memory 
120 is stored in the memory 121. A user-specified program 
may thus comprise one or more rules . 

Alternatively, the user- specif ied program may be gener- 
ated by making a copy of each of the selected rules in 
the memory 12 0 and inserting the copies into the memory 
121; the memory 121 will hereby contain a complete pro- 
gram. Furthermore, the user- specif ied program may be gen- 
erated as a combination of references to rules and in- 
30 structions to the microprocessor 102. 

It should be noted that each rule typically comprises a 
set of instructions which may be considered a subprogram, 
a function or a procedure. But a rule may also just com- 
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prise modification of a parameter e.g. a parameter which 
indicates the speed of a connected motor or a time con- 
stant . 

5 In an expedient embodiment of the invention, a given ac- 
tion may be performed when the state machine changes from 
a first state to a second state. An action may e.g. com- 
prise signalling with sound and/or light to the user to 
indicate the state or type of state which the toy element 
10 has assumed. 

Fig. 4 shows parallel and sequential execution of pro- 
grams. When a user-specified program is generated, the 
rules may be executed as a sequence of rules, in parallel 
15 or in a combination of sequential and parallel program 
execution. 

An example of two rules to be executed in parallel in 
time may be a first rule that a vehicle is to search for 
20 light, and a second rule that the vehicle is to change 
its direction when it detects obstacles. 

An example of two rules to be performed sequentially in 
time may be a first rule that a vehicle is to drive 
2 5 straight ahead, and a second rule that the vehicle is to 
drive in a circular movement. 

Rules Rl 401, R2 402, R3 406, R4 405, R5 403 and R6 404 
provide an example of a combination of sequential and 
10 parallel program execution. 



When rules are executed as subprograms run in parallel in 
time, or in some form of time division between the sub- 
programs, it must be possible to handle situations in 
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which several rules want access to a resource e.g. in the 
form of a motor. In a preferred embodiment, such a situa- 
tion is handled by allocating a priority number to each 
of the rules which may be selected. For example, rules 
5 within the same group of icons on the display may be 
given the same priority number. When the operating system 
118 detects that two rules or subprograms both want ac- 
cess to a resource within a period of time, the rule hav- 
ing the lowest priority number is interrupted or stopped. 
10 The rule with the highest priority number is then allowed 
to use the resource. If only one rule can be selected 
from the same group of icons, a unique and predictable 
program execution of user- specif ied programs is thus 
achieved. 



Fig. 5 shows first and second toy elements, where the 
first toy element can transfer programs to the second toy 
element. The first toy element 501 comprises a microproc- 
essor 507, a 1/0 module 510, a memory 509 and a user in- 
20 terface 508. The toy element 501 moreover comprises a 
two-way communications unit 5 06 for communication via an 
infrared transmitter/receiver 5 05 or for communication by 
means of a light source/ light detector 5 04 which can emit 
and detect visible light. 



Correspondingly, the second toy element 5 02 comprises a 
microprocessor 514, a 1/0 module 515 and a memory 516. 
The toy element 502 moreover comprises a communications 
unit 513 for communication via an infrared transmit - 
3 0 ter/receiver 512 or for communication by means of a light 
source/light detector 511 which can emit and detect 
vi s ible 1 ight . 
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In a preferred embodiment of the invention, the first toy 
element can both transmit and receive data, while the 
second toy element can only receive data. 

Data can be transferred as visible light via a light 
guide 503. Alternatively, data may be transferred as in- 
frared light 517 and 518. Data may be in the form of 
codes that indicate a specific instruction and associated 
parameters which can be interpreted by the microproces- 
sors 507 and/or 514. Alternatively, data may be in the 
form of codes which refer to a subprogram or rule stored 
in the memory 516 . 

The I/O modules 510 and 515 may be connected to elec- 
tronic units (e.g. motors) for control of these. The 1/0 
modules 510 and 515 may also be connected to electronic 
sensors so that the units may be controlled in response 
to detected signals. 



In a preferred embodiment, the fibre 5 03 is adapted such 
that part of the visible light transmitted by it escapes 
from the fibre. It is hereby possible for a user - di- 
rectly - to watch the transmission. The user can e.g. see 
when the communication begins and stops. 

The light through the fibre can transfer data with a 
given data transmission frequency as changes in the light 
level in the fibre. Data may be transmitted such that it 
is possible for the user to observe individual light 
level changes during a transmission (that is at a suit- 
ably low data transmission frequency) , or merely by see- 
ing whether the transmission is going on (that is at a 
suitably high data transmission frequency) . 
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Generally, it is undesirable that part of the light to be 
transmitted through the fibre escapes from the fibre. But 
in connection with communication between two toy ele- 
ments, it is a desired effect, since it is then possible 
5 to watch the communication in a very intuitive manner. 

It is known to a skilled person how to ensure that part 
of the light escapes from the fibre. It can e.g. be done 
by imparting impurities to the sheath of the fibre, or by 
10 making mechanical notches or patterns in the fibre. The 
part of the light which is to escape from the fibre may 
also be controlled by controlling the ratio of the re- 
fractive index of a core to that of a sheath of a light 
guide . 



Fig. 6 shows a toy structure comprising a microprocessor 
controlled toy building element according to the inven- 
tion coupled together with generally known toy building 
elements. The microprocessor controlled toy building ele- 

2 0 ment 601 is coupled on top of a structure 605 of building 
elements and two motors (not shown) . The motors drive a 
wheel at each side of the vehicle, of which only the 
wheel 604 on one side of the toy structure is visible. 
The wheels are driven by a shaft 604 which is connected 

25 with the motor via gear wheels 603. The motors are elec- 
trically connected to the toy building element 6 01 by 
means of wires 615. 

The toy structure moreover comprises two movable arms 60 6 
30 which are pivotable about a bearing 607, so that the 
arms, when being pivoted, can be caused to affect a set 
of switches 608. The switches 608 are electrically con- 
nected to the toy element 601 via wires 609. 
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The toy element may be operated via the keys 613 . The 
display 812 can show information, as described above in 
connection with fig. 2. The toy element 601 has a set of 
electrical contact faces 610 and 611, to which the wires 
609 and 615 may be connected for receiving signals and 
emitting signals, respectively. 



10 



By suitable programming of the toy element 601 the ve- 
hicle may be caused to drive round obstacles that may af- 
fect the arms 606. 



